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, Abstract. We introduce random matrix ensembles that corre- 

ct ' spond to the infinite families of irreducible Riemannian symmetric 

p> | spaces of type I. In particular, we recover the Circular Orthogo- 

D ■ nal and Symplectic Ensembles of Dyson, and find other families 

\ of (unitary, orthogonal and symplectic) ensembles of Jacobi type. 

We discuss the universal and weakly universal features of the global 
and local correlations of the levels in the bulk and at the "hard" 
■ edge of the spectrum (i. e., at the "central points" ±1 on the unit 

circle). Previously known results are extended, and we find new 
simple formulas for the Bessel Kernels that describe the local cor- 
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, relations at a hard edge. 



1. Introduction 

Q-r Local correlations between eigenvalues of various ensembles of ran- 

dom unitary, orthogonal or symplectic matrices, in the limit when their 
size tends to infinity, are known to exhibit universal behavior in the 
bulk of the spectrum. Dyson's "Threefold Way" predicts that 
this behavior is to be expected universally in the bulk of the spec- 
trum, depending only on the symmetry type of the ensemble (unitary, 
orthogonal or symplectic). Unfortunately, for general ensembles this 
conjecture remains open, though in the unitary case (modeled after 
the Gaussian Unitary Ensemble) the universality of the local corre- 
lations has been proven for some classes of families El El 12]- in 
the orthogonal and symplectic cases the extension of results known for 
Gaussian ensembles is technically more complicated but some more re- 
cent work deals with families of such ensembles [2S|. Most of the focus 
has been on non-compact (Gaussian and the like) matrix ensembles. 
In the present article we study families of compact (circular) ensem- 
bles including, in particular, Dyson's circular ensembles: the COE, 
CUE and CSE jTIJ. First we fit Dyson's ensembles into the framework 
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of the theory of symmetric spaces, and then we proceed to associate 
a matrix ensemble to every family of irreducible compact symmetric 
space (all of these are known by the work of Cartan The most 

well-known of these are the families of classical orthogonal, unitary and 
symplectic groups of matrices, for which questions about universality 
have known answers ^7j. These are the so-called compact symmetric 
spaces of type II. Zirnbauer [3U], on the other hand, has constructed 
the "infinitesimal" versions of the other (type I) ensembles, namely 
their tangent spaces at the identity element, which is enough to derive 
their eigenvalue measures. We, however, construct the "global" ensem- 
bles associated to the infinite families of compact symmetric spaces of 
type I in a very explicit manner analogous to Dyson's description of 
his circular ensembles. 



Type 


G/K 


Parameters 


A I 

(COE) 


U(R)/0(R) 


(3 = 1 (not Jacobi) 


A II 

(CSE) 


U(2R)/USp(2R) 


(3 = 4 (not Jacobi) 


A III 


U(2R + L)/U(R + L)x U(R) 


/3 = 2,(a,b) = (L,0) 


BD I 


0(2R + L)/0(R + L) x 0(R) 


/? = l,(a,6) = (^i,-i) 


D III 


SO{4:R)/U{2R) 


(3 = A, (a, b) = (0,0) 


SO(AR + 2)/U{2R+l) 


(3 = A, (a, b) = (2,0) 


C I 


USp{2R)/U{R) 


= 1, (a, 6) = (0,0) 


C II 


USp(4R + 2L)/ 
USp{2R + 2L) x USp{2R) 


/3 = 4, (o,6) = (2L + l,l) 



Table 1. Parameters of the probability measure of the 
eigenvalues for ensembles of type I. 



Besides Dyson's COE and CSE, the other compact matrix ensembles 
of type I are Jacobi ensembles in the sense that their joint eigenvalue 
measure is given by 

(1) 

R 

dv(xi, . . . , xr) oc ] j Xk\^ Y\.^~~ x j) a (^-+ x j) b dxj on [— l,l] R 

l<j<k<R j=l 

for some parameters a,b > —1 (depending on the ensemble, see ta- 
ble [J) and (3 = 1,2,4 (the "symmetry parameter") in the orthogonal, 
unitary and symplectic cases, respectively. Here, the "free" eigenval- 
ues are Xj ± y/—lyj — excluding eigenvalues equal to +1 forced by the 
symmetry built into the ensemble — . Also, R stands for the rank of the 
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corresponding symmetric space, and our interest is in the semiclassical 
limit of the eigenvalue statistics as R — ► oo (L > is a fixed parameter: 
different values of L yield different ensembles.) The name "Jacobi en- 
sembles" comes from the intimate connection between the measure (JT|) 
and the classical Jacobi polynomials on the interval [—1, 1]. 

Afterwards, we prove the universality of the local correlations for 
general unitary, orthogonal and symplectic Jacobi ensembles (previous 
results of Nagao and Forrester are insufficient for our purposes). 
We rely on work of Adler et al PQ. At the "hard edges" ±1 of the inter- 
val, Dyson's universality breaks down and we obtain simple formulas 
for the Bessel kernel in terms of which the hard edge correlations are 
expressed. In a nutshell, for Jacobi ensembles: 

• Away from the "hard edge" x — ±1, the local correlations follow 
the universal law of the GOE 09 = 1), GUE ((3 = 2) or GSE 
{(3 — 4). Namely, in terms of local parameters £j around a fixed 
z Q E (—1, 1) so that Xj = cos(a + (tt/R)^) (z = cosa ), these 
local correlations are given by 

(2) 4 n) (z ; £!,...,£„) =DET(i^(0,£ fc )Wn, 

where DET stands for either the usual (/3 = 2) or quaternion 
{(3 = 1,4) determinant, and Kp is the (scalar or quaternion) 
Sine kernel (cf., equations ([74 |) -(f75 ]) .) 

• At the hard edge z D = +1, the local correlations depend on the 
parameter a of the Jacobi ensemble as well as on (3. In terms 
of local parameters £j > with Xj = cos((-7r / R)Cj) the same 
expression (J2J) holds except that the kernel Kp is to be replaced 

by a Bessel kernel Ki a \c,,i]) given by equations (JHUjl - lpjj) . At 
the hard edge z Q = — 1 the result is obtained by replacing a 
by b. 

2. Dyson's Circular Ensembles as Symmetric Spaces 

For motivational purposes we start by reviewing the construction of 
the circular ensembles of Dyson and their probability measures of the 
eigenvalues in a manner in which the theory of Riemannian symmetric 
spaces is brought into play. 

The Circular Unitary Ensemble (CUE) is the set S = S(N) of all iVx 
N unitary matrices H, endowed with the unique probability measure 
dfi(H) that is invariant under left (also right) multiplication by any 
unitary matrix. This requirement makes the measure invariant under 
unitary changes of bases, hence the ensemble's name. 
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In the study of statistics of eigenvalues, the relevant probability mea- 
sure is the one induced by dfi(H) on the torus A = A(N) C S(N) 
consisting of unitary diagonal matrices 

(3) A = {dmg(\ 1 = e l8 \...,\ N = e ie ")}, 

where 9 = (0i, ...,9 N )e [0, 2tt) n , say. 

To be more precise, let us denote by K — K(N) the unitary group 
of N x iV matrices (its underlying set is just S(N)). Then we have a 
surjective mapping 

K x A -» S 

(4) (k, a) i-> H = kak~\ 

and correspondingly there exists a probability measure dv(a) on A such 
that, for any continuous function / G C(S), 

(5) I f(H)dfi(H) =11 f{kakr x )dv{a)dW^w{k), 

JS J K J A 

where we denote by <iHaar(A;) the unique translation-invariant proba- 
bility measure on K (so here rfHaar = dfi). This measure du(a) can be 
pulled back to some measure on the space [0, 2tt) n of angles G which, 
abusing notation, we denote by du(Q). The measure du(A) (or du(Q)) 
is the so-called probability measure of the eigenvalues (for the CUE). 
We have EH, 

(6) du{Q) oc |Van(e i0 )| 2 d9 on [0, 2tt) n . 

Here the symbol "oc" stands for proportionality up to a constant (de- 
pending only on N), dQ = dB\ . . . dQjq is the usual translation-invariant 
measure on the space of angles B, e l@ = (e 101 , . . . , e ldN ) and, for a vector 
x = (x\, . . . , xn), Van(x) is the Vandermonde determinant 

(7) Van(x) = det (x^ 1 ) = TT (ar fc - zA 

NxN 3 J-l J' 

l<j<k<N 

The construction of the Circular Orthogonal Ensemble (COE) is as 
follows. One starts with the set S = S(N) of iV x N symmetric unitary 
matrices H. However, because S(N) is not a group, the choice of the 
probability measure dfi(H) is not as obvious as it was for the CUE. 
Let G = G(N) again be the group of N x N unitary matrices g, 
and K = K(N) C G(N) be the group of orthogonal matrices. Let 
fl(g) = (g T )~ 1 be the involution of G whose fixed-point set is K. Then 
we may identify 

G/K ~ S 

(8) G3g ^ H = gQ(g)- 1 =:g 1 - n , 
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and by general principles the translation-invariant probability measures 
on G and K determine a unique G-invariant measure d/i(g) = dfi(H) 
on G/K ~ S which satisfies 

(9) / /(<7)dHaar(<7) = / ( f f{gk)M^r{k)\ dfi{g), 
JG Jg/k \Jk J 

where on the right-hand side g stands for a choice of an element g G G 
such that gK = g. The left translation-invariance of <iHaar(g) ensures 
that dfi(g) is invariant under left translations by elements of K, there- 
fore the measure dfi(H) is invariant under orthogonal changes of bases, 
hence the ensemble's name. 

The probability measure of eigenvalues dv{a) = du(Q) is again that 
which satisfies (JHJ) (with the same torus A C S as for the CUE). It is 
known that ^T] 

(10) du{Q) oc | Van(e ie )|d0 on [0,271-)*. 

The constructions of the Circular Symplectic Ensemble CSE and 
of its measure on eigenvalues du(Q) are very similar to the case of 
the COE. Here S(N) consists of 2N x 2N self-dual unitary matrices. 
Namely, letting 

(id ' = ~' N )' 

then a matrix H is self-dual if it equals its dual H D := JH T J T . If 
we let G = G(N) be the group of 2N x 2N unitary matrices and 
K = K(N) be the subgroup of symplectic matrices k (they satisfy 
kJk T = J) then K is the fixed-point set of the involution Q(g) = 
(g D )~ l . The identification (jHj) continues to hold and © again defines 
the probability measure dfi(H) = dfi(g) of the ensemble. It is invariant 
under symplectic changes of bases. 

The torus A consists here of diagonal matrices: 

(12) A = {diag(e 101 , . . . , e l ° N , e idl , e i0N )} 

with twice-repeated eigenvalues. Then the probability measure of the 
eigenvalues is characterized by (0), and indeed 

(13) dv{&) oc | Van(e ie )| 4 de on [0,277)*. 

Summing up, the measure on eigenvalues for the circular ensembles 
is given by 

(14) du{Q) oc | Van(e ie )| /3 rf6, 

where (3 = 1,2,4 in the orthogonal, unitary and symplectic cases, re- 
spectively. 



6 



EDUARDO DUENEZ 



Remark. It can be appreciated that the parameter (3 determines the 
strength of the repulsion between nearby eigenvalues: this repulsion is 
stronger the larger {3 is. Hence anything that measures the local inter- 
actions between eigenvalues is likely to depend on (3. This is the case, in 
particular, of the "local correlations" between eigenvalues, cf. section HJ 

Remark. The apparent dissimilarity in the construction of the measure 
dfi(H) in the case of the unitary vs. the orthogonal and symplectic 
ensembles is not essential. In fact, the unitary ensemble S(N) is still 
a quotient G{N)/K{N) where G{N) = U(N) x U(N) is the direct 
product of two copies of the unitary group, and K(N) is the diagonal of 
G(N) (isomorphic to the unitary group itself). If we identify S(N) with 
the "anti-diagonal" {H = (g^g' 1 )} C G(N) and take Q{g,h) = (h,g) 
then the construction of the ensemble and of the measures dfi(H) and 
dv(&) follows through in essentially the same manner. We omit the 
details. The key observation is that the constructions above show that 
the circular ensembles are examples of Riemannian globally symmetric 
spaces. 

3. Compact Symmetric Spaces as Matrix Ensembles 

Any Riemannian globally symmetric space X is locally isometric to a 
product of irreducible ones (the symbol "~" means "is locally isometric 
to"): 

(15) X ^\[X\ C) x\[xf c) x E\ 

i j 

where the Xj^ (resp., the Xj) are irreducible symmetric spaces of 
compact (resp., non-compact) type, and E e = (E 1 ) 1 is ^-dimensional 
Euclidean space (a flat manifold). In the case of the circular ensembles, 
we have 

CUE = U(N) « SU(N) x S 1 

COE = U{N)/0(N) w (SU(N)/SO(N)) x S 1 

(16) CSE = U(2N)/USp(2N) w (SU(2N)/USp(2N)) x S 1 

where in each case the first factor is an irreducible symmetric space of 
the compact type and the other (Euclidean) factor is a circle S l ~ E 1 
(we write S 1 rather than E 1 to emphasize that the spaces are compact). 
In the language of differential geometry, the probability measure of a 
circular ensemble is the one determined by the natural volume ele- 
ment of the manifold. Hence the natural question arises as to how to 
construct a random matrix ensemble corresponding to each (infinite) 
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family of irreducible symmetric spaces of compact type. The restric- 
tion to infinite families is due to the need to have a large parameter 
N such that the number of eigenvalues grows with N, and then we are 
interested mainly in limiting statistics. 

The presence of the Euclidean factor S 1 (which comes from the subset 
of scalar multiples of the identity matrix within the ensemble) is rather 
convenient and natural. If we were to define "irreducible" circular en- 
sembles analogously to Dyson's circular ensembles, except requiring 
that they consist of matrices with unit determinant, then the spaces so 
obtained would be irreducible symmetric spaces of the compact type 
(i. e., the factors S 1 would disappear from (|16p). However, the mea- 
sure on eigenvalues would no longer be translationally invariant (under 
transformations of the form i— > Q+(t, . . . , t)). Namely, instead of the 
measure (j!4|) . we would obtain an asymmetric version given by the same 
formula but with 6 replaced by = (6i, . . . , 9n-i, —Q\ — - ■ -—On-i) an d 
with d0N omitted from the volume element dO. As may be expected 
from such a loss of symmetry, a rigorous analysis of these "irreducible" 
ensembles would be more involved. 

Since we are considering only compact symmetric spaces, it is pos- 
sible to normalize the natural volume element to obtain a probability 
measure. This is not the case for symmetric spaces of non-compact 
type. To clarify the difference, we analyze the example of the classical 
Gaussian matrix ensembles, which also fit within the framework of the 
theory of symmetric spaces (the construction is analogous to that of 
the circular ensembles): 

GUE « SL(N, C) jSU (N) x E 1 
(17) GOE « SL{N, R)/SO(N) x E 1 

GSE « SU*{2N)/USp{2N) x E 1 . 

Finding the probability measure on eigenvalues also reduces to a factor- 
ization of measures dfi(H) = dH&ax(k)dv(a) in the sense of ©, where 
K is still the group of invariance (orthogonal, unitary, symplectic) of 
the ensemble's measure, but where A ~ E N is now a Euclidean space, 
which in the case of these ensembles consists of real diagonal matrices 
which can be parametrized by iV-tuples A = (Ai, . . . , Xn) of real num- 
bers. However, the measure dfi(H) is certainly not the one obtained 
from the Riemannian volume element cfflaar(g) of G through (fTU|) since 
the latter is not normalizable. A choice has to be made to make 
this measure into a finite one while preserving its left and right K- 
invariance. One possibility is provided by a "Gaussian" probability 
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measure on G proportional to 

(18) e -^ tr92 dHaar(#) 

(the symmetry parameter (3 = 1,2,4 corresponds to the orthogonal, 
unitary and symplectic cases, respectively, just as in the case of the 
Orthogonal ensembles), which in turn yields the measure on eigenval- 
ues: 

(19) du(a) oc e-^ A ?| Van(A)|^dA. 

It can be rightfully argued that the choice of the Gaussian normaliza- 
tion for the measure on these matrix ensembles is rather arbitrary and 
motivated by analytical rather than conceptual considerations. The 
point we wish to state here is that making such a choice is unavoid- 
able. For the compact spaces, however, no such choice needs to be 
made since their volume element already determines a unique proba- 
bility measure. We will henceforth restrict our attention to compact 
ensembles for that reason. 

The general definition of a Riemannian symmetric space of the com- 
pact type is as follows. We start with a compact semisimple Lie algebra 
(i. e., exp(ad(g)) C GL(g) is compact) having an involutive automor- 
phism uj. Then q splits into the sum of the (+1)- and (— l)-eigenspaces 
of uj as 

(20) g = 6©p. 

(the subspace peg can be identified with the tangent space to G/K at 
the identity coset o = K/K). G/K is called a Riemannian symmetric 
space of the compact type if 

(1) K C G are Lie groups (G connected). Their Lie algebras are 
t,g; and 

(2) there is a (necessarily unique) involutive automorphism Q of 
G such that (G n ) C K C G n , where G n is the fixed-point 
set of Q in G (a Lie subgroup of G) and (G n ) Q is its identity 
component (then dQ e = uj). 

The complete list of irreducible symmetric spaces (up to local isom- 
etry) is known by the classical work of Cartan. As we will explain 
later, it suffices to consider one matrix ensemble in each equivalence 
class of locally isometric symmetric spaces, because the measures on 
eigenvalues for locally isometric ensembles are the same. 

The irreducible symmetric spaces of compact type are classified into 
spaces of "Type I" and "Type II". Of these the latter are simplest 
to describe: they are the (connected) simple compact Lie groups G, 
provided with a bi-invariant (under both left and right translations) 
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Riemannian metric. Proving that such a G is a bona fide symmetric 
space of the compact type as defined before involves expressing it as 
(G x G)/G in a manner analogous to what we did at the end of section|21 
for the CUE. 



Type 


G/K 


Rank R 


A I 


SU(N)/SO{N) 


A - 1 


A II 


SU(2N)/USp(2N) 


A- 1 


A III 


SU(M + N)/S(U(M) x U(N)) 


min(M, A) 


BD I 


SO(M + N)/SO(M) x SO (AO 


min(M, A) 


D III 


SO{2N)/U{N) 


LA/2J 


C I 


USp{2N)/U(N) 


A 


C II 


USp{2M + 2N)/USp{2M) x USp{2N) 


min(M, A) 



Table 2. The infinite families of symmetric spaces of type I. 



Up to local isometry, the infinite families of Type II spaces are 
those of orthogonal SO(N), unitary SU(N) and (compact) symplec- 
tic USp(2N) groups. The random matrix theory of these spaces is 
well-known |17j . 

The Type I spaces, on the other hand, are those symmetric spaces 
G/K of the compact type with G simple. The bi-invariant Riemannian 
metric on G determines that on the quotient G/K. Table [21 lists the 
infinite families of Type I spaces, up to local isometry. 

Without loss of generality, we assume henceforth that min(M, A) = 

A. 

Choose a maximal abelian subalgebra a of q contained in p. Then 
the subgroup A = exp(a) is a torus that projects onto a totally flat 
submanifold AK/K C G/K (a flat torus). This totally flat manifold 
is maximal, and its dimension is the rank R of the symmetric space 
G/K. Thus, R = dim(AK/K) = dim A = dim a. 

Guided by the exposition in the previous section, it is reasonable to 
regard as ensembles the symmetric spaces G/K of type I endowed with 
their normalized Riemannian volume elements dfi{jg), which satisfy (JHJ). 
However, the elements of these ensembles are not matrices but rather 
cosets g = gK e G/K. 

Theorem 1. The infinite families of type I ensembles G/K can be 
realized as matrix ensembles S. Indeed, (jHJ) maps G/K bijectively onto 
a submanifold S C G, and G is a classical group of matrices, hence S 
is a space of matrices. Under this correspondence, AK/K C G/K is 
mapped onto the torus A. The action of K on G/K by left translation 
corresponds to the conjugation H i— > kHk^ 1 on matrices H e S , and 
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any H G S is conjugate to some a G A under this action. Moreover, 
two matrices in A are conjugate under K if and only if they have the 
same eigenvalues. 

The proof of the theorem is a long exercise in elementary linear 
algebra. We shall omit most of the details, which can be found in jlUj . 
In what follows we describe the explicit matrix ensembles S which are 
the images of the imbedding (JHJ). 

In each case, we choose the involution Q of G so that its fixed- 
point set is exactly K. The cases of A I (COE) and A II (CSE) have 
been discussed already. We introduce some notation (recall that is 
defined by equation (JHJ)): 



(21) J' N 

(22) Jmn 



in 



(23) J' A 



MN 



(24) /; 



MN 



In 
Jm 



v 

J M 



J. 



N 



27V x 2 V 



(2M+2/V) x (2M+2A0 



V , 

N J (2M+2N)x(2M+2N) 



1 N 



(M+N)x(M+N) 



The canonical bilinear antisymmetric matrix J n in the definition of the 
compact symplectic group USp(2n) will be taken to be (|TT|) in the case 
of ensembles with one parameter N (n = N), and (|2*2*|) in the case of 
ensembles with two parameters M, N (n = M + N). 

A III. Take M > N > 1 and G(M,N) = U{M + N). Then 
K(M, N) = U(M) x U(N) is the fixed-point set of the involution 

(25) g^g n --= I'gi', 

with /' = I' MN as in (IM. 

The symmetric space U(M+N)/U(M)xU(N) = SU{M+N)/ S{U{M)x 
U(N)) is realized as the matrix ensemble 

(26) S(M, N) := {H = GI' such that G G U(M + N) 

is Hermitian of signature (M,N)}, 

under the identification JSJ). A choice of the abelian torus A is given 
by 

(27) A = { ( m N -%A N 

%A N $IA N 
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where A at = diag(Ai, . . . , \n) is an arbitrary diagonal unitary matrix. 
Besides the eigenvalue 1 with multiplicity M — N, the eigenvalues of 
the matrix in (|27p come in R = N pairs Xj, Xj 1 , \Xj\ = 1. 

BD I. Let M > N > 1, G(M,N) = 0(M + N), and K(M,N) = 
0(M) x O(N) be the fixed-point set of the involution (|25|) with I' = 
I'mn as in (EU- Then G/JT = 0(M + N)fO(M) x O(N) = SO{M + 
N)/S(0(M) x O(JV)) w SO{M + N)/SO(M) x 50(A^) (the last two 
spaces are locally isometric). 

The symmetric space 0(M + N)/0(M) x O(N) can be realized as 
the set of matrices 

(28) S(M, N):={H = gl' such that g G 0(M + iV) 



by means of (JHJ). The torus A is just as in (|2*7j) and we get the same 
description for the eigenvalues. 



D III. Let G(N) = SO(2N) and K(N) = SO(2N) n 5p(2A^, C) ~ 



with J = J N as in dUJ). We can identify G{N)/K{N) with the set 

(31) 5(iV) := {H E SO(2N) s. t. HJ is "dexter" antisymmetric} 

using equation (|5j). We now explain what we mean by a dexter matrix. 
Say G is a 2A^ x 2A^ orthogonal antisymmetric matrix. Then an or- 
thogonal change of basis puts it into the canonical form Jn- However, 
this may not be possible by means of a proper orthogonal change of 
basis (i. e., of determinant +1). Specifically, when iV is even, the two 
complex structures ± Jjv are equivalent (under, say, the proper orthog- 
onal change of basis J' N as in (|21|)). but when iV is odd they are not. 
We call G dexter if, by a proper orthogonal change of basis, it can be 
taken into the canonical form +Jn- Thus, for iV even, all orthogo- 
nal antisymmetric matrices are dexter, whereas for iV odd, only half 
of them are (in this case, conjugation by J' N takes "dexter" matrices 
into "sinister" ones and vice- versa). Now, for H e S(N), G := HJ is 
dexter antisymmetric, so our discussion above proves the surjectivity 
of the mapping. 



is symmetric of signature (M,N)} 



U(N): 



(29) 
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The torus A is 
(32) 

(®-A R 



A 



SAr 
^A R 



V 

/I 



^A R 
-%A R 



\ 

MA R J 



for N even; 



m R 

%A R 



-%A R 
^A R 



3?A 



V 



R 



3A 



R 



for A" odd. 



-%a r 



> ■ 



where A R = diag(Ai, . . . , \ R ) is a diagonal unitary matrix. Besides the 
double eigenvalue 1, which occurs for A" odd, the matrices in (J32)) have 



-i \-i 



R quadruples of eigenvalues Xj, Xj, Xj , A 

C I. Here G(N) = USp{2N), and K(N) ~ U(N) is the fixed-point 
set of the involution (|25j) with V = I' NN as in (|24|). Explicitly, 



(33) 



C/(iV) 9 5 



(5 



T\-l 



G if(JV). 



Identify G(AT) /K{N) with the set 
(34) 

5(AT) := {# = GI' s.t. G G U(2N) is Hermitian and JG 



-GJ} 



by means of (JSJ). The torus A is 
(35) A = 



KAjv 
SAjv 



with Ajy a unitary diagonal matrix as before. The eigenvalues occur in 
pairs just as in the case of (|27jl with M = N. 

C II. Let M > N > 1 and G(M, AT) = USp{2M + 2JV). We take the 
complex structure J = J M n as in (|22jl . Then Af(M, JV) = USp(2M) x 
USp(2N) consists exactly of those elements that also stabilize 



(36) 



with J^ /7V as in 
involution 



MN 



MN 



(37) 



so that K(M, N) is the fixed-point set of the 
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We can realize the symmetric space G(M, N)/ K(M, N) as the set of 
matrices 



(38) S(M,N):~- 



{H = GV such that G G USp(2M + 2N) 

is Hermitian of signature (M,N)}, 



where we mean the quaternionic signature as discussed below. We 
recall that any matrix G G Sp(2n, C) which is Hermitian (G = G T ), 
has real eigenvalues and can be diagonalized with a symplectic matrix 
g G Sp(2n, C), that is, 



(39) 



Q-'Gg 



A 



-i 



for some real diagonal matrix A n . The usual signature of G is of 
the form (2a, 2b), so we call (a, 6) the quaternionic signature. The 
identification is, of course, given by (JSJ). The torus A is 

/Im-n 



(40) 



.4 



\ 1 



3Av 



l M-N 



V 



with Aat unitary diagonal. Besides the eigenvalue 1 with multiplicity 
2(M — N), the other eigenvalues occur in quadruples like those of the 
matrices in (|32j). 

For each of the ensembles, the torus A, which has dimension equal to 
the rank R of the symmetric space, is parametrized by diagonal unitary 
matrices 



(41) 



A R = diag(Ai, . . . , \ R ), 



IA; 



1. 



Abusing notation, we will also write A# for the vector (Ai, . . . , Xr). 
The tangent space a to this torus at the identity is identified with the 
space of i?-tuples zG = (i9x, ■ ■ ■ , iOr), 0j G R. Recall that we identify 
p with the tangent space to G/K at the base-point o = K/K. The 
exponential maps Exp of G/K and exp of G are related by 



(42) 



Exp(X) = exp(X)K G G/K 



for X G p = T (G/K). For iO G a, exp(i0) is given by the matrix on 
the right-hand side of equations (|2*7j) . (jH^)? (J23) and (j4~Uj) . respectively, 



provided we choose A,- 



A6 n 



111 



ID- 
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Proposition 1 (KAK decomposition). LetGjK be a symmetric space 
of the compact type and A C G be as above. The mapping 

K x Ax K -» G 

(43) (ki,a,k2) i— > A^afo 
zs a surjection. 

The KAK decomposition has an integral counterpart. 

Proposition 2 (Weyl's integration formula). There is a measure dV(a) 
on A such that, for any f e C{G), 

(44) / /((?)^= / / / f{kxak 2 )dv{a)dk 2 dk x . 

JG JK JK J A 

(We have simplified our notation by dropping the name "Haar" of the 
respective invariant measures.) Denote by S + the set of positive roots 
of the symmetric Lie algebra (g,cu), and by m a the multiplicity of a 
positive root a G S + . Then 

(45) dv(a) oc Y[ | sin a(Q)\ ma da = A(Q)da, 

a<=E+ 

say, where 6 is chosen so a = exp(iO). 

(With the notation above, we write i® = log(a). This is well- 
defined modulo 2tt.) 

Now recall that the (positive) roots of ($j, uj) are certain non-zero 
real- valued linear functionals on a (in fact one should speak about the 
roots which are positive with respect to a fixed Weyl chamber in o). 
The root systems of the irreducible orthogonal Lie algebras of compact 
type are well-known by Cartan's work. 

Proposition 3. The positive roots and multiplicities for the irreducible 
orthogonal Lie algebras of type I are as follows (let L = M — N in the 
case of ensembles with two parameters). 
• A I. 



• A II. 

• A III. 



a 


m a 


Ok-Oj, 1 < j < k < R 


1 




a 


m a 


Ok-Oj, 1 < j < k < R 


4 




a 


m a 


Ok-Oj, 1 < j < k < R 


4 



• BD I. 
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• D III. N even. 



D III. N odd. 



CI. 



• C II. 



a 


m a 


9 k ±0j, 1 < j < k < R 


1 


Oj, ±<3<R 


L 




a 


m a 


9 k ±0j, 1 < j < k < R 


4 


20j, 1<3<R 


1 




a 


m a 


6 k ±6 jj l<j<k<R 


4 


Oj, l<j<R 


4 


20j, i<j<R 


1 




a 


m a 


9 k ±0j, 1 < j < k < R 


1 


20 i, ±<j<R 


1 




a 


m a 


9 k ±9j, 1 < j < k < R 


4 


9j, l<j<R 


4L 


29j, l<j<R 


3 



We are now ready to derive the measure on eigenvalues for ensembles 
of type I. 

Theorem 2. The measure on eigenvalues for a symmetric space of 
type I is given by 



(46) dv(a) oc A(0/2)da = J] 



sin -«(6) 



da, iO = log a. 
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Using Weyl's integration formula, we deduce that, for any / e C(S), 
(47) 

/ f(H)dn(H) = [ f((gky~ n )dkd^g) (by ©) 

= / fig^dg (since = e) 

= / / / /((hahy-^dhdv^dk! 
JK J a Jk 

mf{{k 1 a) 1 - n )dk 2 dv{a)dk 1 
_r 

= / / fiikaf-^dv^dk 
Jk J a 

— I I f(ka 2 k~ 1 )du(a)dk. (since a 1_n = a 2 ) 

iif J A 

This ought to be compared with which defines the measure <iz/(A) 
on eigenvalues. A key property of the measure du(a) defined by (|45|) is 
reflected in the fact that A(6) = A(6') if 9 = 9' mod n (this follows 
in general from the fact that the roots take integral values on the "unit 
lattice" exp _1 (e), and can be verified for ensembles of type I directly 
using proposition OJ). From that observation, it follows that: 

(48) 

/ / f(ka 2 k- l )dv(a)dk(x [ [ f(kexp(2tQ)k- 1 )A(Q)dQdk 
Jk J a Jk J[o,2n] R 

= 2 R I [ f{kex V {2iQ)k- 1 )A{Q)dQdk 

Jk J[0,n] R 

= [ [ f(kexp(ie)k- 1 )A(B/2)dedk 

Jk J[0,2tt] r 

= [ [ f{kak- 1 )A(Q/2)dadk. 
Jk J a 

When put together with (JJ7J), this proves 

Now we restrict attention to the most interesting case, that of "class 
functions" / G C(K\S), that is, those functions on S which depend 
only on the eigenvalues of the matrix, viz 

(49) f(kak~ l ) = /(a). 

The tori A are parametrized by i?-tuples (Xj = e 1 ® 3 ). From the 
knowledge of the structure of the set of eigenvalues of the matrices 



MATRIX ENSEMBLES ASSOCIATED TO SYMMETRIC SPACES 17 

in these tori, we see that for all the ensembles of type I except for 
Dyson's A I and A II, changing the sign of any 9j does not change 
the set of eigenvalues since these always come in pairs {e j } (with 
single or double multiplicity), hence any class function / 6 C(K\S) is 
determined by its values on exp([0, ir] R ) C A, and correspondingly 



(50) 



f(H)dfx{H) = [ f{a)dv{a) oc / /(exp(z6))A(e/2)rfe 
= 2 R [ /(exp(ie))A(e/2)de. 

J[0,n] R 

Hence, except in the cases of A I and A II, it is convenient to regard 
the measure on eigenvalues as one supported on [0, ir] R . Noting that 
the contribution of a pair of roots 9k ± 0j to A(G/2) is 



(51) 



Ok — 0j\ . ( ' 9k + 0j 
sin I sin 



oc | cos 9k — cos 9j | , 



it is clear that for all the ensembles of type I, except for the COE and 
the CSE, the measure on eigenvalues is proportional to the measure 
(52) 

]J | Van(cos6)| /3 [ J | sin^| p | sin(^/2)| Q rfe, on [0,tt} r . 

±<3<k<R l<j<R 

(Here (3 = 1, 2, 4 according to the multiplicity m a of the roots 9k ±9j.) 
Because | sin0| = |1 - cos^ll + cos^] 1 / 2 and | sin(0/2)| = 2~ l ' 2 \l - 
cos^l 1 / 2 , the above is proportional to the measure 
(53) 

] ] | Van(cos6)| /3 ] J |1 -cos%| p |l + cos^jl^rfO, on[0,7r] . 

l<j<k<R i<j<R 

We make the change variables 8hx = cos to obtain 
(54) 

dv(x) oc Yl |Van(x)|^ j [ \1 - x J \ a \l + xtfdx, on[-l, 1] R , 

l<j<k<R ±<j<R 

where a = p — 1/2, b = q — 1/2, and <ix = dx\ . . . dxR. The weight 
function 

(55) w(x) = \l-x\ a \l + x\ b on [-1,1] 

is that with respect to which the classical Jacobi orthogonal polynomi- 
als P^ b) (x) are defined, so a matrix ensemble for which the probability 
measure of the eigenvalues is given by (|54|) is called a Jacobi ensem- 
ble (with parameters (a, b)). For {3 = 1,2,4 we call such an ensemble 
orthogonal, unitary or symplectic, respectively. 
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Recall that, for the COE and CSE, the probability measure of the 
eigenvalues is given by (jTljl . It coincides with that given by Weyl's 
formula (proposition |2J) since 



(56) 



\e i6k - e i6j \ = 2 


. ( Ok — 9j \ 
sin - 




v 2 ; 



For completeness, table 01 is the analogue of table Q for (the infi- 
nite families of) symmetric spaces of type II (compact Lie groups). 
The CUE is a circular ensemble with (3 = 2 and measure on eigen- 
values ([14)1. whereas the orthogonal and symplectic groups are unitary 
Jacobi ensembles. 



Type 


S(N) 


Parameters 


a N (CUE) 


U(N) 


(3 = 2 


b N 


SO(2N + l) 


/3 = 2,(a,6) = (i,-i) 


Cat 


USp{2N) 


/3 = 2,(a,6) = (i,i) 


d N 


SO(2N) 


/3 = 2,(a,6) = (-i,-i) 



Table 3. Parameters of the probability measure of the 
eigenvalues for ensembles of type II. 



4. Universality of Local Correlations 

In this section we analyze the limiting correlation functions for gen- 
eral Jacobi ensembles. As we have shown, with the exception of Dyson's 
COE (A I) and CSE (A II), the ensembles of type I are special cases 
of (orthogonal, unitary or symplectic) Jacobi ensembles. 

We consider the joint probability measure of the R levels (we speak 
about levels rather than eigenvalues since the natural variables to use 
are Xj = dtXj) given in the general form 

(57) ^(x^r) = Pr(x r ) dx R , 

where x# = (xi, . . . , xr) is an i?-tuple of levels. The n-level correlation 
function I R n \'x n ) is defined by 

(58) /jj n) (x n ) = 7^r~T| J- ■ 'J Pr(^u, x n +i, x R )dx n+1 ■ ■ ■ dx R . 

It is, loosely speaking, the probability that n of the levels, regardless 
of order, lie in infinitesimal neighborhoods of x±, . . . , x n (but the total 
mass of the measure (x n )c?x n is now R\/{R — n)\ and not 1). 
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The semi-classical limit R — > oo is of great interest. The so-called 
"universality conjecture" (which dates back to the work of Dyson [T%] ) 
states that the local correlations of the eigenvalues in the bulk of the 
spectrum tend to very specific limits that depend only on the symmetry 
parameter (3. Special cases of the truth of this assertion are known. In 
particular, in the unitary case (3 = 2, the result is proven in certain 
generality [HI 13 12 El, but for (3 = 1,4 it is known only for special 
ensembles such as the circular ensembles of Dyson [TT] E3 EI] and, 
by work of Nagao and Forrester (22] , for most Laguerre ensembles and 
Jacobi ensembles. However, the latter assumes that the parameters a, b 
are strictly positive, hence it is not applicable to ensembles of type I 
(cf., tabled). 

It is an extremely important fact that for general orthogonal, unitary 
and symplectic ensembles the correlation functions can be expressed as 
determinants (which discovery goes back, in the unitary case, to the 
work of Gaudin and Mehta [Tolll9j . and in the orthogonal and symplec- 
tic cases to Dyson's study of his circular ensembles, and later extended 
by Chadha, Mahoux and Mehta [TBI El 122] to the general case). In 
the case of unitary Jacobi ensembles there exists a scalar- valued kernel 
{ x i y) defined in terms of the classical Jacobi orthogonal polyno- 
mials Pn (x) (the projector kernel onto the span of the first R Jacobi 
polynomials) satisfying [24 

(59) I^W = ^( K Rp( x j, x k))j,k=l,...,n- 

In the case of the orthogonal (resp., symplectic) Jacobi ensembles, there 
exists a matrix-valued kernel [21] (alternatively, a "quaternion" kernel) 



rum k'^Ut „\ - I s «> y) 7 S (*> y) - 5 < x - y) 
(60) k R0 ( X , y) - y D ,^ (x y) s( ^ (x y) 

where 5 = 1 (resp., 5 = — the e-term is absent in the symplectic case), 



(61) e{z) = -sgn(z) = - — , 

and the scalar kernel is defined in terms of the skew-orthogonal 
polynomials of the second (resp., first) kind depending on the weight (J55)) 
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and the other quantities are given by 

(62) I$\x,y) = - f S ( ;> b \x,z)dz, 

J X 

(63) D$\x,y) = %S<$\x,v) } 

(64) S$V(x,y) = S<$\y,x). 

The matrix kernel ()60|) is self-dual in the sense that K^g (y, x) = 

Kftp\x,y) D (cf., section |2I) • The correlation functions themselves are 
given by 



(65) ^( x «) = \J det(K R/3 (xj, x k )) nxn . 

Indeed, if the matrix (Knp(xj, Xk)) n xn is interpreted as a quaternion 
self-dual matrix |2~U| . then the right-hand side of (jB3j) is its Dyson's 
"quaternion determinant" qdet |HJ US HH] , so (JfiHj) can be rewritten: 

(66) ^9 (xn) = qdet(K R p(xj,x k )) nxn . 

Remark. In what follows we will sometimes unify notation by writing 
DET (all caps) to signify the usual determinant when (3 = 2 and the 
quaternion determinant when (3 = 1,4. Thus, equations (JoUj) and (jo^j) 
will be written 

(67) /j$(xn) = DET(A-^(x js x fc )) nxn . 

The first quantity of interest is the (global) level density. Indeed, 
since the first correlation function has total mass R, one might expect 
that the probability measure R~ 1 I R 1 \x)dx on [—1, 1] tend to a limiting 
measure as R — > oo. We define the level density to be the corresponding 
probability density function: 

(68) p(x) = lim R^I^ix). 

R—>oo 

Assuming p(x) to be continuous, the bulk of the spectrum is the set 
{x : p(x) > 0}: points where the level density vanishes or blows up to 
infinity are excluded from the bulk of the spectrum. 

Theorem 3. For the orthogonal, unitary or Jacobi ensembles asso- 
ciated to the weight function f!55|) . the global level density is given by 

(69) p(x) = J— on (-1,1). 

7TV 1 — X 

The limit in (}68|) is attained uniformly on compact subsets of (—1, 1). 
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This theorem will be proved in the following section. 

If we revert to the angular variable 9 with x = cos 9, we see that 



so the level density g{9) = 1/tt on (0, n) is constant: the eigenvalues 
become equidistributed on the unit circle (with respect to its invariant 
measure), and uniformly so away from the central eigenvalues ±1, in 
the semiclassical limit R —>■ oo. The bulk of the spectrum excludes the 
edges ±1. 

The local n-level correlations are the "local" semi-classical limits of 
the n-level correlations . When localizing near the neighborhood 
of a fixed level z Q belonging to the bulk of the spectrum, these local 
correlations are universal in the sense that they depend neither on the 
specific ensemble nor on the choice of z a but only on the symmetry 
parameter (3. In particular they coincide with the local correlations 
of the Gaussian Orthogonal (f3 = 1), Unitary (/3 = 2) or Symplectic 
(/3 = 4) ensemble, respectively. For Jacobi ensembles the bulk of the 
spectrum consists of the open interval (—1, 1), whereas the local cor- 
relations near the "hard edges" ±1 (which correspond to the "central 
eigenvalues" ±1 on the unit circle) have a different behavior which is 
sensitive to the parameters (a, b) of the ensemble. 

Remark. As we shall see later, the level density vanishes to some or- 
der at, say, the hard edge +1 depending on the parameter a (which is 
natural since a determines the order to which the weight function (Jo7)j) 
vanishes at Xj = +1). The local correlations fail to follow Dyson's uni- 
versal "threefold way" , but rather depend on this parameter. The same 
limiting behavior occurs at the hard edge of Laguerre ensembles |23j . 
so that, at least conjecturally, these "universal" laws — manifestly dif- 
ferent from Dyson's bulk regimes — describe the behavior of the local 
correlations at a hard edge for general orthogonal, unitary or symplec- 
tic ensembles. 

We now fix a level z a 6 [—1,1]. Given that the eigenvalue density 
is uniform, it is natural to change variables from x to £ stretching the 
angles by a factor R, namely setting 



(70) 



p(x)dx 



g(9)d9 



71 



(71) 




where a Q = arccosz D (note that the change of variables depends on 
R). The semiclassical limit of the correlation functions is obtained by 
letting R tend to infinity. What the factor tt/R accomplishes is that, 
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on the bulk of the spectrum, the local level density (i.e., the local limit 
of the correlation function I^l) will be = 1. 

Theorem 4. For the orthogonal ((3 = 1), unitary ((3 = 2) and sym- 
plectic ((3 = 4:) Jacobi ensembles associated to the weight function (jB3|) . 
the local correlations are as follows: 

• Bulk local correlations ( independent of (3 and of the choice of a 
fixed z = cos a ^ ( — 1) 1) )■ 
— Local level density: 

(72) p(0 = l™ {Rp{x))- l l^Jx) = l, eeR. 



R-^oo 



where x depends on £ as in (J7T|) and p(x) is the global level 
density (p3§j) . 
— Loca/ correlations: 

(73) 4 n) (z ;O = Jim ( J Rp(^))-"/g(x ri .) = DET(i^&, £ fe )) nxn , 

where x n and £ n are related by (fTTj) ^ reca// taat DET stands 
for the usual or the quaternion determinant in the cases of 
(3 = 2 and (3 = 1,4, respectively). In the case (3 = 2, K-i is 
the scalar Sine Kernel 

{sin7r(£— 77) £ 1 
P(0 = 1, £ = ?7- 
In i/ie case /3 = 4 tae matrix Sine Kernel K4 is given by 



(75) K^,v) 



where 

(76) S&ri) = K 2 (2^2 V ), 

h{Z,v) = - J" s 4 {£,t)dt, 

In the case (3 = 1 the matrix Sine Kernel K\ is given by 
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where 

(78) S 1 {£,r t ) = K 2 (£, v ), 



• Hard edge z a = +1 (a a = 0). 

— Central point level density. For £ > 0: 

(79) lim (^) ig(x)=p /s (0 

( where x depends on £ by (|71|) j zs given by: 

(80) #(£) = |(7r0[J o (7r0 2 -J a -i(7r£)J a+1 (7r£)], 



(81) #(£) = p { t +l) 



(82) 



71 f°° 
(0+ o-WlC^O / >W 



2tt£ 



#(0 = #(20-1^(2^)^^+1. 
— Loca/ correlations. For £ n > : 

83) 4 n) (+l;0 = lim (-) %g(x n ) = DET(^,&)), 



wi/i x n related to £ n fry ()71|) . T/ie scalar "Bessel Kernel' 



K 2 = K 2 is given by 



[p 2 (0. £ = ? /- 

For /3 = 1,4 the matrix Bessel Kernels are given by the 
same expressions of (j75)) - (|78j) . except that the bars are to 
be replaced by hats and S\ = §[ , £4 = are given by 



(85) S[ a \C,v) = J^K? a+1 \t, V ) + |j 2a+1 H) jf° J2a + i(t)dt, 

(86) ^(£,77) = W^ a - 1) (2£,2r ? )-^J a _ 1 (27T7 ? )^J a _ 1 (t)^. 



where the J u are the Bessel functions of the first kind. 
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0.5 1 1.5 2 2.5 3 



Figure 1. Graphs of for a = -1/2 (the "even" 

Sine Kernel, solid), a = +1/2 (the "odd" Sine Kernel, 
dotted), and a = (the Legendre Kernel, dashed). 



The next section will be devoted to the proof of this theorem. 

Remark. The local limits at the edge z = — 1 are given by the same 
formulae replacing the parameter a by b. 

Remark. The integral in (|8fi|) diverges for —1 < a < 0. However, in the 
next section we provide an alternative version of that equation which 
is well-defined for all a > — 1. 

Remark. In connection with the hard edge correlations for the classical 
orthogonal and symplectic groups (tableEJ), we remark that the unitary 
Bessel kernel (J84|) . in the case a = +1/2 (resp., a = —1/2), coincides 
with the "odd" (resp., "even") Sine Kernel [T7j : 

(87) g^ {( , v) = ^Z2i T ^±3l. 



5. Proofs 

In this section we prove theorems El and |U First we remark that the 
unitary case has been studied in the work of Nagao and Wadati [23}I25|. 
but we reproduce the proofs here for completeness and also to show 
that the hypothesis a > —1 is, in a certain sense, unnecessary. Also 
we remark that Forrester and Nagao [23 have studied the hard edge 
correlations directly, using skew-orthogonal polynomial expressions for 
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Figure 2. Graphs of p^^) for a ■■ 
+ 1/2 (dotted), and a = (dashed). 



3 4 
-1/2 (solid), a = 




Figure 3. Graphs of pf\0 for a 
(dotted), and a = 2 (dashed). 



(solid), a = 1 



the matrix kernels Kri,Kra, but their results apply only when the 
parameters a, b are strictly positive, and in view of the application to 
symmetric spaces this restriction is unacceptable (see table [T]) . Also, 
their somewhat more complicated formulas for the limiting quantities 
Si, S4 are given in terms of iterated integrals of Bessel functions. Here 
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we take advantage of the more recent work of Adler et al which provides 
simple "summation formulas" for the quantities Sri, Sra- 

5.1. Some preliminary results and formulas. The various results 
we quote on Jacobi polynomials can be found in Szego's book [2E] 
and in his article on asymptotic properties of Jacobi polynomials j2Z] 
(reproduced in his collected papers j2H])- Stirling's formula and the 
Bessel function identities can be found, for instance, in the tables of 
Gradshteyn and Ryzhik [TSJ. We denote by P^' B \x) the classical 
Jacobi polynomials defined by 
(88) 

f_i\iV / j \ N 

4/1 | \B P (A,B) U _ \ L ) I a \ I"/-, xAT+A/i , „\N+B 



(1 - x)\l + x) B P^\x) = ^ j [(1 - xf+ A (l + xf+ B ] . 

When A, B > —1, these polynomials are orthogonal on [—1,1] with 
respect to the weight 

(89) w(x) = |1 -x\ A \l + x\ B , 

but they are not normalized. However, the formula ()88|) is meaning- 
ful for arbitrary (real or complex) values of the parameters A, B, and 
defines a polynomial in A, B, x of degree (at most) N in x. In fact 

V / A + N\ fB + N\ fx-l\ N ~ k fx + l ' 



(91) P ( N AB \+l 



k=0 

In particular 

A + 
N 

The derivative of a Jacobi polynomial is related to another Jacobi poly- 
nomial by the identity (the apostrophe denotes differentiation with re- 
spect to x) 

(92) P ( N A ' B) \x) = l -(N + A + B + l)P {A ^ B+1 \x). 

Proposition 4 (Darboux's formula). (With an improved error term 
due to Szego For arbitrary reals A,B, 

(93) 

P {A ' B) {cos6) = {ttN)- 1 / 2 (sin^J ( cos ^) cos(^ + 7 ) 

+ E, 

„, Ar A + B + l ( . l\ 7T 

N' = N H , 7 = - L4' 



2 2' 
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for < 9 < tt, where the error term E satisfies 

(94) E = e- A - 3/2 0(N~ 3/2 ), uniformly for c/N < 9 <n - e, 

for any positive constants c, e, and the constant implied by the O symbol 
depends only on c, e,A,B. 

Proposition 5 (Hilb's formula). (As generalized by Szego to Jacobi 
polynomials |2B] J For A > — 1 and any real B: 

(95) 

+ E, 

where N' has the same meaning as in \9^l and the error term E is 
given by 

' >/ 2 0(iV- 3 / 2 ) if c/N < 9 < 7i - e, 
9 A+2 0(N A ) ifO<9<c/N, 

where c, e are arbitrary but fixed positive constants, and the constants 
implied by the O symbol depend on A, B, c, e only. 

The restriction to A > —1, however, is too strong for some pur- 
poses, and we will need the following formula, also due to Szego [27] 
(reproduced in [29"]): 

(97) 



(96) E 



sm9 1 V 29 J 



(98) R 



2J V 2 
x J A {N'9) + R, 

with N' as in (J93j) . Here A, B are arbitrary reals. The error term R 
satisfies: 

(9^- A 0{N- 3 / 2 ) if c/N < 9 < 7r-e, 
[0(iV A - 2 ) ifO<0<c/A^, 

where c, e are fixed positive numbers, and the constants implied by the 
O symbol depend only on A, B, c, e. It must be noted, however, that the 
error term R of (|55jl does not depend on 9 on the range < 9 < c/N, 
which makes this formula less useful than (|93j) with the error term (|9^jl 
for 9 in this range. 

Recall Stirling's asymptotic formula for the Gamma function: 

(99) logT(x) = ( x — - ] logx— x+- log27r+0(x _1 ), as x — ► oo. 
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The Bessel functions of the first kind are defined by the series 
(100) 

oo 2k 

■W=(j) Et-D W^ + *+!) ■ «C\(-oo,0], ,ER; 

they satisfy, among many others, the relations: 

(101) J' v {z) = J v _ x {z)- V -J v {z), 

(102) J^z) = -J u+l {z) + - z J u {z), 

(103) J^z) = ^[J v ^{z) - J v+1 {z)\, 

(104) J„ +1 (z) = —J v {z)- J„_i(*), 

(105) ^[z v Uz)\ = z u Jv-i(z), 

(106) ^-[z-"J v {z)] = -z-»J u+1 {z). 

We also have 



(107) / J v = 2^J ; 



fc=0 



(108) / J u {t)dt = 1 for v > -I. 



o 



5.2. Asymptotics of the Unitary Jacobi Kernel. In this section 
we recall the proofs of some of the results of Nagao and Wadati [2*4] . 
which will be needed later on in the analysis of the orthogonal and 
symplectic cases. 

Using the Christoffel-Darboux summation formula [28J, the scalar 
kernel K^ 3 ^ can be written in the form 

(109) 

K ^\ x , v) - I-*-* T(N + m N + A + B + l) 



2N + A + B T(N + A)T(N + B) 



x y/w(x)w(y)- 



x-y 
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for x 7^ y, and 
(110) 

{ a,b) ( , 2- A ~ B T(N + 1)T(N + A + B + 1) 

*m \?,x) 2N + A + B T(N + A)T(N + B) 

x w(x)[P^\ X )P^(x)-P^\x)P^(x)}. 

We observe that the kernel K N2 given by ()1U9|) and (jllOj) is well-defined 
for A, B > — c for any real constant c provided N is sufficiently large. 
First consider the global level density 

(111) p(x) = lim N~ x K{x,x). 

N— >oo 

Using Darboux's formula (|93|) together with the identity (|92|) in the 
expression (jllOj) for the kernel, we find: 

(112) K§f>(x,x) = — £= + 0(1) 

7TV 1 — X 

where the implied constant depends only on e for — l + e<x<l — e. 
Equation ()112|) proves (J59*|) (in the unitary case). 

A density function .D = D(xi, . . . , x n ) defines a measure .D dxi . . . dx n . 
Under a (monotonically increasing or decreasing) differentiable change 
of variables Xj = X(uj), this density is transformed into the density 

(113) V( Ul , ...,u n )= (f[ \X'( Uj )\ j D{X( Ul ), . . . , IK)). 

If the density D is given as a determinant with a (scalar) kernel K(x, y), 
namely D = det(K(xj,Xk)) nxn , then the change of variables reflects 
itself in the kernel in the following fashion: 

Lemma 1. After the (monotonic) differentiable change of variables 
u — > x = X(u), the correlation functions are given as the determi- 
nant (J59|) defined using the kernel 

(114) K(u, v) = yJ\X'{u)X'{v)\K{X{u),X{v)). 



This is clear since the introduction of the factor yJ\X'{u)X'{v ) | re- 
sults in multiplying the determinant (|59*|) by YYj=i \X'(uj)\. 

The localization at some — 1 < z Q = coso; < 1 given by the change 
of variables (|7Tj) leads us to consider the limit 

K^ b) ^ V )=hm {N^Mp¥)Y l K^\x } y) 

(115) 

lim {Np{z ))- l K^\ X) y), 



N^oo 
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with x, y related to £,77 by (J7TJ), which from Darboux's formula (J9~3j) 
can be easily seen to be the Sine Kernel (J74j) . independently of the 
value of z D (as long as —1 < z Q < 1), for any real a, b, and the limit is 
attained uniformly on compacta. 

For the localization at z Q = +1 (a Q = 0) — localization at z Q = — 1 is 
analogous provided a and b are interchanged — , we use the same change 
of variables (J7TJ) with £ n > 0. To compute the limit 

(116) 

= lim (Ap^))" 1 ^^), 

iV^oo 

we use Szego's formulas (JHSJ), (HHJ), in conjunction with ()1U9|) and (jllUj) : 



(117) K ( 2 a) (^v) = -p^HJ' a MJa^v) - JaWvvJLto)]- 

Using the derivation formula ()l()2j) we rewrite this kernel in the form (jHljl . 
For the case £ = r; we start with the expression (jll(J|) and use the 
derivation formula (J92|) to find: 

(118) 

Applying the derivation formula (jl01|) and the recurrence formula ()104|) 
this can be rewritten in the form (JHUj) . 

5.3. Asymptotics of the Orthogonal Jacobi Kernel. We start 
with some general remarks. If a density P = P{x%, . . . ,x n ) is given 
as a quaternion determinant with a self-dual matrix kernel K (y, x) = 
K(x,y) D , namely P = qdet(Q(xj,Xk))i, then under a differentiable 
change of variables Xj = X(iij) the density is still given as a quaternion 
determinant. 

Lemma 2. After a (monotonic) differentiable change of variables u — > 
x = X(u), a density function 

(119) P(xi, ...,x n ) = qdet(K(xj, x k )) 

defined in terms of some self-dual matrix kernel (8 — 0, 1) 
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with 

ry 

(121) I(x,y) = - S{x,z)dz, 

(122) D(x,y) = d x S(x,y), 

(123) S T (x,y) = S(y,x). 

is transformed into the density 

(124) V(u u ...,u n ) = qdet(/C(ttj, u k )), 



where 

(125) K(u,v) 



S(u,v) T(u,v) — 6e(u — v) 
V(u,v) S T (u,v) 



(126) S(u,v) = S{X{u),X{v))\X'{v)\ = ±S{X{u),X{v))X'{v) 

pv 

(127) T(u,v) = — / S(u,w)dw, 

J u 

(128) V(u,v) = d u S(u,v), 

(129) S T (u,v) =S{v,u). 

For the proof, we need first: 

Lemma 3. Let H = H D = J n H T J^ be a 2n x 2n self-dual complex 
matrix. Let kj, j = 1,2, ...,n be arbitrary complex constants. Set 
K = diag(fci, . . . , k n ). Then the matrices 
(130) 

Hi = diag(7, K)H diag(iT, 7) H 2 = diag(-7, K)H diag(-K, J) 

(where I = I n is the n x n identity matrix) are both self-dual, and 

(131) qdet(#i) = det(K) qdet(H) = qdet(H 2 ). 

The verification that Hi and H 2 are self-dual is trivial. On the other 
hand, since (qdet X) 2 = det X for any self-dual matrix X, we have that 



(qdetm) 2 = (qdet(H 2 )) 2 = (det(K)) 2 det(H) 
[ ' = (det {K)) 2 (qdet {H)) 2 . 

Hence equation ()131j) . which is an equality between polynomials in the 
entries of the matrices involved, must hold up to a sign. Setting K = I n 
we see that the first equality in (|131|) holds, and setting K = —I n , so 
H 2 = —H, the validity of the second equality in ()131|) is equivalent to 
the easy fact that qdet(— H) = (— l) n qdet H = det(— I n ) qdet H. 
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Proceeding to the proof of lemma 121 we first observe that, after the 
change of variables u — ► x, the density P(xi, . . . , x n ) transforms into 
the density 

n 

(133) V(u h ...,u n )= P(X( Ul ), . . . , I(n n )) J] \X'(uj)\. 

3=1 

We apply lemma 0] with H = (K(X(uj),X(uk))) n xn an d kj = \X'(uj)\ 
to conclude that ()124j) holds with either of the two kernels (we write 
X(u,v) for (X(u),X(v))) 
(134) 

/ S(X(u,v))\X'(v)\ ±(I-6e)(X(u,v))\ 
±[ ' } ~ {±D(X(u,v))\X'(u)\\X'(v)\ S T (X(u,v))\X'(u)\) " 

The plus and minus signs correspond to applying the first and second 
of the equalities in (|131|) . respectively. If x — > u preserves orientation, 
then we observe that e(X{u) — X{v)) = e(u — v) and conclude by 
a simple application of the chain rule and a change of variables in 
the integral that the kernel K, + coincides with /C from (|125|) for the 
choices ()126j) - (jl29|) . If x — > u reverses orientation, we choose the minus 
signs, observe that e(X(u) — X(v)) = —e{u — v) and proceed exactly 
as before to see that /C_ coincides with f!125|) in this case. 

Lemma 121 explains the relations (|75|l between the entries of the lim- 
iting kernels Kp and also of Kp {(3 = 1,4). The relations certainly 
hold when R is finite after applying the change of variables (|7T|) to 
the the matrix kernel Kr@ so as to obtain another kernel K.r/3- They 
can be shown to continue to hold in the limit either by noting that 
the sequence of scalar kernels {<Sr/3(£, ti)}r=o ^ s a norma l sequence of 
analytic functions (i.e., it converges uniformly on compacta), or by di- 
rect verification that each of the sequences {Sr^}, {Irq}, {K-Rp}, {Sr^} 
converges to the correct limit as R — ► oo. In what follows we will only 
consider the limit of the quantity Sr@ which alone determines the ma- 
trix kernel Kr^. 

Let A = 2a + 1,5 = 26+1, where a, b are the parameters of the 
orthogonal Jacobi ensemble. Assume also that R is even. Observe that 
A, B > — 1 if a, b > —1. The summation formula of Adler et al [1 

expresses the orthogonal kernel Sj^ using the unitary kernel Kj^lf \ 
and another term. As we shall see, this other term is negligible in the 
localized limit (in the bulk of the spectrum), but it does contribute to 
the edge limit. 
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The summation formula for the quantity S^f\x,y) of (JHUJ) is as 
follows 0: 



(135) S%{ b \x,y) = J j -^ K^ 2 (x,y) + c R - 2 $r-i(v)&I>r-2{x)- 
Here e denotes the integral operator (cf., eq. (JHH)) 

(136) (e/)(x)= [ e{x-y)f(y)dy, 



and we have set 

(137) Mt) = ^N' B \t) = (1 - t) (A - 1)/2 (l + t) (B - 1)/2 Pi AB) (t) 
and 

_ 1 T{N + 2)T(N + A + B + 2) 



(138) Cjv 



T(iV + A +1^(^ + 5 + 1)' 



The quantity S^f^ determines the entries of the matrix kernel K^l 
as per equations (J52j) - (J54*)l . 

From Stirling's formula f)99jl . the asymptotic behavior of the coeffi- 
cient Cat is 

(139) c N ~ 2^- B - 1 iV 2 , as JV -> oo. 
Lemma 4. For any rea/ A, B: 

(140) lim ^' B) (cos0) = 

for < cf) < it, uniformly on compacta. 

This follows immediately from Darboux's formula (J93|) . 

This lemma is, however, insufficient to understand the asymptotics 
of the function eipN as iV — > oo since it says nothing about the behavior 
of ipN near the edge. First we note: 

Lemma 5. For A > — 1 and B arbitrary: 

(141) lim JV-V^Ccos^/JV)) = 2 ^^M, 

N—ioo (p 

(142) lim ^' B) (cos(0/A^))sin(0/iV) = 2^J A (0). 

The limits hold uniformly on compact subsets of (0, oo). 
These follow from Szego's formula (|95|). 
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Lemma 6. For A, B real with A > — 1 and any < 9 < n we have: 

(143) lim N / ^' B) (cos0)sin0rf0 = 2^, 

N^oo J Q 

i-e/N re 

(144) lim N / ^' B) (cos0)sin0d0 = 2^ / J A . 
N -°° Jo Jo 

These follow again from Szego's formula (|9"5j) and equation ([108)1 . 
When — 1 < A < 0, the dependence on 9 of the second of the error 
terms in (|96|) is critical to ensure that the contribution of this error 
term to the integral is negligible (in particular, this lemma cannot be 
proven using the alternate formula ()98|) unless A > 0.) 



Corollary 1. For -1 < A, B and < 9 < n: 

(145) lim N(e^' B) )(cos9) = 0, 

N— >oo 

(146) 

Jim N(e^ B) )(cos(9/N)) = 2^ (l - jf J^j = 2^ J J A . 

This follows from the previous lemma applied to both ipfj'^ an d 
il)^' A \ We also used ()1U8|) to obtain the last equality. 

We localize at some z Q = cos a Q G (—1,1) using the change of variable 
x — > £ of (|7ip. The limit to consider is 
(147) 

^• 6) (£,77) = lim (Wtf^y) = Jim {Np{zo))-^ (x, y) 
By the lemmas above, the second term on the right-hand side of ()135|) 



is negligible in the limit. Also, the factor w yzp- * s 1 ^ n ^ ne limit. Thus, 

the limit ()147|) is equal to the limiting unitary kernel, namely the Sine 
Kernel, whence the expression ()78|) . 

As for the central point, let us now localize at z = +1. Using the 
summation formula ()135|) . lemma El and corollary Q we readily find: 



;i48) 



7r£ 

J2a+l{t)dt 







oo 



^ 2a+l \^ v ) + ^J 2a+1 (n V ) J ^ J 2a+1 (t)dt. 
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As we remarked already, the conditions a > — 1 and A > — 1 are 
equivalent since A = 2a + 1. Thus we have derived a weak universality 
law for the local correlations at the central points ±1 for any a, b > — 1. 

Lemma 7. Let K a (x,y) = xJ a+1 / 2 {x)J a - X / 2 {y) - J a -i/2(x)yJ a+1 / 2 {y). 
Then 

(149) ^K a ± 1/2 (x, y) - ^K aTl/ 2(x, y) 

( — y^ \ 

=F ( ^=T ) Ja-l/2 T l/2{x)J a -l/2±l/2{y)- 



xy 

(This equation stands for two different equations, one with the top signs 
and another with the bottom signs.) 

We prove the equation with the choice of the top signs (the other 
case is analogous). Indeed, expanding the left-hand side we obtain: 

(150) x 3 / 2 J a+1 (x)y- 1/2 J a (y) - x 1/2 J a (x)y 1/2 J a+1 (y) 

- x^ 2 J a (x)y 1/2 J a ^(y) + x- 1 ' 2 J a _i(x)y 3 / 2 J a (y). 

The central terms can be combined into —2ax 1 ^ 2 J a (x)y~ 1 ^ 2 J a (y) us- 
ing the identity (jl()4j) and expanded using this same identity into 
— £ 3//2 J a _x{x)y~ 1 ' 2 J a (y) — x 3 / 2 J a +i(x)y~ l l 2 J a (y). Two terms cancel 
out, and the remaining two factor to give the right-hand side of 
We now have, using lemma [7[ 



£ £ 2 - r] 2 



and similarly 



(152) Sk^^) = ^ki A+l \^r 1 ) + nJ A+1 {^)J A {nr ] ). 
From (UnZJ): 

J Ja) ±2J At i(ttO = J Ja T 2- 
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The last two equations provide alternative forms of the kernel S[ a \ 
namely 

(154) 



(155) 



1 " / J2a-l(t)dt 




^f +2) (e,r/) + fj 2a+1 M 



I - / J2a+z(t)dt 




As before, the terms in brackets can be replaced by 



5.4. Asymptotics of the Symplectic Jacobi Kernel. Here we set 
A — a — 1, B — b — 1 where a, b are the parameters of the symplectic 
Jacobi ensemble. Note that here a,b > —1 corresponds to A, B > —2. 
With Cjv as in ()138J) and ^ = as m P37j) . the summation 

formula in this case reads 



(156) S%f\x,y) 



1 1-x 2 
2V 



2/) - ^C 2Ji _lV'2ii(2/)5V'2ii-l(^) ) 



where the operator 5 acts by 



(157) Sf(x) = [ f(t)dt. 

J X 

The formula ()156j) only holds verbatim when a > (that is, A,B> 
— 1), since the integral defining Sip^ is divergent for A < — 1. How- 
ever, we note that the skew orthogonal polynomials of the second kind 
are analytic functions of the parameters a, b > —1 (corresponding to 
A, B > —2), hence the kernel i£jv4 is an analytic function on a, b > — 1. 
Thus, we must find a suitable analytic continuation of (|156|) valid for 
A, B > —2. First we remark that, although the original kernel K^r? 
of unitary Jacobi ensembles is defined for A, B > —1, equation ()1U9|) 
is well-defined and analytic for A,B> —2 if R > 1 (which we will 



MATRIX ENSEMBLES ASSOCIATED TO SYMMETRIC SPACES 



37 



assume). We write 



(158) 5^' B \x)= f\l-t)^' 2 {l + tf B - l ^ 2 P^ B \t)dt 



J X 




The first integral on the right-hand side is well-defined and analytic for 
A > -2. The term P^ B) {1) = ( A + N ) (cf., equation (jSIJ)) vanishes for 
A = — 1, which is sufficient to extend the second integral on the right- 
hand side to a well-defined analytic function on the range A > —2. It 
is easy to rewrite that integral as an incomplete Beta function and use 
well-known results to achieve the extension, but one can also proceed 
elementarily as follows. Integrating the second integral by parts we 
obtain, for A > — 1: 



and the latter is an analytic function of all A. Then both terms on 
the right-hand side of ()159|) are analytic functions of A > —2 for — 1 < 
x < 1, so this last equation provides the analytic extension of the 
integral (j!58)l defining SiPn{x), which is sensu stricti undefined for 
A < —1, to an analytic function on A > —2. 

The rest of the reasoning is analogous to that in the orthogonal 
case. The only technical difficulty arises because the error term (jHEJ) 
in Szego's formula does not depend on 9 in the range < 9 < c/N, 
effectively making the reasoning of the previous section inapplicable 
when —2 < A < — 1. This is to be expected since the summation 
formula only makes sense after being analytically continued. In what 
follows we prove that the various limits of the kernel do in fact depend 



(159) 




Observe that 



(160) 
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analytically on the parameter A, thus allowing the expressions obtained 
for A > — 1 to be extended to A > —2. 

Using Szego's formula (|97j) (valid for all A), there is no problem to 
obtain this variant of lemma EJ 

Lemma 8. For any A,B,9 real and < ip < n we have: 



(161) lim N I ^' B) (cosV>)sinV># = 2^ / <7a- 
Lemma 9. Using equation A159\) . the expression 

p0/N 

(162) N / ^' s) (cos 0) sin 

can 6e analytically continued to a regular function on A > —2. As 
N — > oo, this function tends to a limit which is also analytic for A > —2 
and coincides with \144\} f or A> —1. 

We change variables <p ^ <p/N. As before, we split the integral to 
rewrite (|162j) in the form 



OC 



(163) 

B 



2 {A+B)/ 



sin cos 

2N \ 2N 



+2M+b ,/ 2< ,b )(1) £ ^±y ^ cos ±y P (A, B){1)dij> 

The first of these terms is analytic for A > —2, the second one has an 
analytic continuation given by (J159J) . It is easy to see that this second 
term has the asymptotic behavior: 

(164) 2^ J' (sin±y (cos^)" P^ B \l)d<t> 

N\N-lJ \N J 
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as N — > oo, and from Stirling's formula ()99|1 . the binomial coefficient 
(li-i) = ^(Ao"r(A+2) = 0(A^ j4+1 ), hence this second terms is asymptot- 
ically negligible. As for the first term in ()163|) . we first write 

(165) 



2N J JV " i \ NJ N 

where we have used the derivation formula ([92)1 . We can now use 
Szego's formula (|9l)|) to estimate P^^' B+1 ^ since A + 1 > —1. The 
upshot is that the limit of ()162j) as N — > oo can be written as the 
following integral, which is an analytic function of A > — 2: 

(166) _ 2 ^+ B )/ 2 / [% A ^- A J A+1 (tP)d^d(P. 



o ./o 



Using the Bessel function identity ()106|) we can simplify the above 
integral, for A > — 1: 

(167) 2^/ 2 f° JaMW, 



o 



which is in agreement with lemma El 

We note that the expression (|167|) can be easily continued to an 
analytic function of A > —2 without the need to rewrite it as the 
double integral ()166j) . Namely, using (|107|) we have, for A > — 1, 



(168) / J A {(j>)d(j ) ^J A+1 {e)+ J A+ 2(<P)d<p. 
Jo Jo 

The expression on the right-hand side is analytic for A > —2 and 
provides the desired analytic continuation. 

The global level density is derived identically to the previous sec- 
tion. The limiting kernel in the bulk of the spectrum is given by the 
sum of two terms: S^^, 2rj) and another term which is negligible in 
the limit. For the central point z = +1, the lemmas above yield the 
following expression for the limiting kernel: 

(169) Si a) (t, V ) = J^k^ A) {2^2ri)- ^JaM £* J A (t)dt, 

whe+re the last integral is to be understood in the sense of equa- 
tion ()168j) for A < —1. Using equations ()151j) and ()152j) together 
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with (|153j) and the equation above, the kernel can be rewritten in ei- 
ther of the forms: 

(170) S ( ;\t, 77) = J|j^ a) (2£ 2 V ) - | J a -i(27T77) jf"* J a+1 (t)dt, 

(171) S { ;\t,v) = ^Kt 2 \^,2v) ~ |^-i(27T77) jT* J fl _ 3 (t)dt. 
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